Diversity in Classifier Ensembles: Fertile Concept or Dead End?
نویسندگان
چکیده
Diversity is deemed a crucial concept in the field of multiple classifier systems, although no exact definition has been found so far. Existing diversity measures exhibit some issues, both from the theoretical viewpoint, and from the practical viewpoint of ensemble construction. We propose to address some of these issues through the derivation of decompositions of classification error, analogue to the well-known biasvariance-covariance and ambiguity decompositions of regression error. We then discuss whether the resulting decompositions can provide a more clear definition of diversity, and whether they can be exploited more effectively for the practical purpose of ensemble construction.
منابع مشابه
Diversity in multiple classifier ensembles based on binary feature quantisation with application to face recognition
In this paper we present two methods to create multiple classifier systems based on an initial transformation of the original features to the binary domain and subsequent decompositions (quantisation). Both methods are generally applicable although in this work they are applied to grey-scale pixel values of facial images which form the original feature domain. We further investigate the issue o...
متن کاملThat Elusive Diversity in Classifier Ensembles
Is “useful diversity” a myth? Many experiments and the little available theory on diversity in classifier ensembles are either inconclusive, too heavily assumption-bound or openly non-supportive of the intuition that diverse classifiers fare better than non-divers ones. Although a rough general tendency was confirmed in our previous studies, no prominent link appeared between diversity of the e...
متن کاملUsing diversity measures for generating error-correcting output codes in classifier ensembles
Error-correcting output codes (ECOC) are used to design diverse classifier ensembles. Diversity within ECOC is traditionally measured by Hamming distance. Here we argue that this measure is insufficient for assessing the quality of code for the purposes of building accurate ensembles. We propose to use diversity measures from the literature on classifier ensembles and suggest an evolutionary al...
متن کاملMeasuring the Stability of Feature Selection with Applications to Ensemble Methods
Ensemble methods are often used to decide on a good selection of features for later processing by a classifier. Examples of this are in the determination of Random Forest variable importance proposed by Breiman, and in the concept of feature selection ensembles, where the outputs of multiple feature selectors are combined to yield more robust results. All of these methods rely critically on the...
متن کاملExperimental Study on a 1000W Dead-End H2/O2 PEM Fuel Cell Stack with Cascade Type for Improving Fuel Utilization
Proton exchange membrane fuel cells (PEMFCs) with a dead-ended anode and cathode can obtain high hydrogen and oxygen utilization by a comparatively simple system. Nevertheless, the accumulation of the water in the anode and cathode channels might cause a local fuel starvation degrading the performance and durability of PEMFCs. In this study, a brand new design for a polymer electrolyte membrane...
متن کامل